A Barzilai-Borwein descent method for multiobjective optimization problems

نویسندگان

چکیده

The steepest descent method proposed by Fliege and Svaiter has motivated the research on methods for multiobjective optimization, which received increasing attention in recent years. However, empirical results show that Armijo line search often a very small stepsize along direction, decelerates convergence seriously. This paper points out issue is mainly due to imbalances among objective functions. To address this issue, we propose Barzilai-Borwein optimization (BBDMO), dynamically tunes gradient magnitudes using Barzilai-Borwein’s rule direction-finding subproblem. We emphasize BBDMO produces sequence of new directions compared Morovati et al. With monotone nonmonotone techniques, prove accumulation generated are Pareto critical points, respectively. Furthermore, theoretical indicate can achieve better BBDMO. Finally, comparative numerical experiments reported illustrate efficiency verify results.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Relaxed Steepest Descent and Cauchy-Barzilai-Borwein Method

The negative gradient direction to find local minimizers has been associated with the classical steepest descent method which behaves poorly except for very well conditioned problems. We stress out that the poor behavior of the steepest descent methods is due to the optimal Cauchy choice of steplength and not to the choice of the search direction. We discuss over and under relaxation of the opt...

متن کامل

Inexact Barzilai-Borwein method for saddle point problems

This paper considers the inexact Barzilai-Borwein algorithm applied to saddle point problems. To this aim, we study the convergence properties of the inexact Barzilai-Borwein algorithm for symmetric positive definite linear systems. Suppose that gk and g̃k are the exact residual and its approximation of the linear system at the k-th iteration, respectively. We prove the R-linear convergence of t...

متن کامل

The cyclic Barzilai–Borwein method for unconstrained optimization

In the cyclic Barzilai–Borwein (CBB) method, the same Barzilai–Borwein (BB) stepsize is reused for m consecutive iterations. It is proved that CBB is locally linearly convergent at a local minimizer with positive definite Hessian. Numerical evidence indicates that when m > n/2 3, where n is the problem dimension, CBB is locally superlinearly convergent. In the special case m = 3 and n = 2, it i...

متن کامل

Quadratic regularization projected alternating Barzilai–Borwein method for constrained optimization

In this paper, based on the regularization techniques and projected gradient strategies, we present a quadratic regularization projected alternating Barzilai–Borwein (QRPABB) method for minimizing differentiable functions on closed convex sets. We show the convergence of the QRPABB method to a constrained stationary point for a nonmonotone line search. When the objective function is convex, we ...

متن کامل

Barzilai-Borwein Step Size for Stochastic Gradient Descent

One of the major issues in stochastic gradient descent (SGD) methods is how to choose an appropriate step size while running the algorithm. Since the traditional line search technique does not apply for stochastic optimization algorithms, the common practice in SGD is either to use a diminishing step size, or to tune a fixed step size by hand. Apparently, these two approaches can be time consum...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: European Journal of Operational Research

سال: 2023

ISSN: ['1872-6860', '0377-2217']

DOI: https://doi.org/10.1016/j.ejor.2023.04.022